home *** CD-ROM | disk | FTP | other *** search
-
- DESCRIPTION
-
- -- Script to download HTML systems across the network --
-
- GetURL.rexx is an ARexx script which will download World-Wide Web pages.
- With a simple command line it will download a specific page, and with
- more complex command lines it will be able to download specific sets of
- documents.
-
- The intention was to create a tool that allowed local caching of important
- web pages and a flexible way of specifying what pages are important. The
- script has no GUI as of yet but may have at some stage in the future.
-
- If you have ever tried to download and save to disc a 200 page document
- using Mosaic, then you know what this script is for. Mosaic will only
- let you load a page, then load it to disc, then load another page etc.
- This is a very frustrating process. GetURL automates this process and
- will run in batch mode without user intervention.
-
- The major features of GetURL.rexx are as follows:
-
- * doesn't require AMosaic, so you can be browsing something else
- with AMosaic whilst this is running
-
- * save pages to your hard disc so that they can be read offline and
- you can also give them to friends on a floppy disc. Who knows,
- you may even be able to sell discs containing web pages :-)
-
- * flexible set of command line switches that allow you to restrict the
- type of pages that it downloads
-
- * ability to specify files for the lists of URLs that it keeps so
- that any search for pages can be stopped and restarted at a later
- date. i.e. you could run GetURL for 2 hours a day whilst you are
- online and gradually download everything in the entire universe
- and it won't repeat itself.
-
- * includes the ability to download itself when there are new versions.
-
- * will use a proxy if you have access to one, in order to both speed up
- access to pages and also to reduce network load.
-
- * will download binary files (*.gif, *.lha) as easily as text and html
- files.
-